AD-A12S  147 


UNCLASSIFIED 


TEMPORAL  STR8ILITV  OF  THE  FACTOR  STRUCTURE  OF  THE 
ORGANIZATIONAL  ASSESSMENT  PACKAGE(U)  LEADERSHIP  AND 
MANAGEMENT  DEVELOPMENT  CENTER  HAXUELL  AFB  AL 
J  M  HIGHTOHER  DEC  82  LMOC-TR-82-2  F/G  5/1 


■ydttV'n"  :  *»4#VC‘  -*404* 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OF  STANDARDS-I963-A 


TR-82-2 
ber  1982 


/* 


Temporal  Stability  of  the  Factor  Structure 

of  THE 

Organizational  Assessment  Package 


Capt  Janice  M.  Hightower,  USAF 


December  1982 


OTJC: 

QSi"1^ 


Approved  for  public  release,  distribution  unlimited. 

i’SHIP  AND  MANAGEMENT  DEVELOPMENT  CENTER 
INING  COMMAND 
Air  Force  Base,  Alabama  36112 


Technical  Reports  prepared  by  the  Leadership  and  Managenent  Development 
Center  (LMDC),  Maxwell  Air  Force  Base.  Alabama,  report  a  completed  research 
project  documented  by  literature  review  references,  abstract  and  testing  of 
hypotheses,  whether  stated  or  Implied.  Technical  Reports  are  Intended 
primarily  for  use  within  the  Air  Force,  but  may  be  distributed  to 
researchers  outside  the  USAF,  both  military  and  civilian. 

The  views  and  opinions  expressed  In  ths  document  represent  the  personal 
views  of  the  author  only,  and  should  not  In  any  way  be  construed  to  reflect 
any  endorsement  or  confirmation  by  ch?  Deptrtmeni  of  Defense,  the  Department 
of  the  Air  Force,  or  any  other  agency  of  the  United  States  Government. 

This  report  has  been  reviewed  end  cleared  for  open  publication  and/or 
public  release  by  the  appropriate  Office  of  Public  Affairs  (PA)  In  accord¬ 
ance  with  AFR  190-17  and  Is  releasable  x  the  Katlontil  Technical  Information 
Center  where  It  will  be  available  to  tit  general  public,  ‘including  foreign 
nations. 

This  Technical  Report  has  been  reviewed  and  Is  approved  for  publication. 


LAWRENCE  0.  SHORT,  Major,  USAF  LLOYD  WOODMAN.  JR..  Lt  Col.  USAF 

Chief.  Research  Operations  Director.  Research  and  Analysis 


JOHN  E.  EM10NS 
Colonel ,  USAF 
Commander 


*.•  V  V  V.V-  V  --  V  v  V  V-VUV.VAV. 


UNCLASSIFIED _ _ 

SECURITY  CLASSIFICATION  OF  THIS  PAPE  (Whm>  Dim  Knitted) 

REPORT  DOCUMENTATION  PAGE  befoI^c^^Sg^orii 

1.  REPORT  NUMBER  "  12.  GOVT  ACCESSION  NO.  ».  RECIPIENT’S  CATALOG  NUMBER 

LMDC-TR-82-2  yAO  •  Ad  (ft  IV/ 


1.  REPORT  NUMBER 

LMDC-TR-82-2 


14.  TITLE  (end  Submit) 


Temporal  Stability  of  the  Factor  Structure 
of  the  Organizational  Assessment  Package 


17.  AUTHORO) 


S.  TYPE  OP  REPORT  A  PERIOD  COVERED 


Final 

6.  PERPORMINO  ORG.  REPORT  NUMBER 


S.  CONTRACT  OR  GRANT  NUMBER^*) 


Captain  Janice  M.  Hightower 

9.  PERFORMING  ORGANIZATION  MAME  AND  AODRESS  10.  PROGRAM  ELEMENT.  PROJECT.  TASK 

Directorate  of  Research  and  Analysis  area  *  work  unit  numbers 

Leadership  and  Management  Development  Center  (ATC) 

Maxwell  Air  Force  Base,  Alabama  36112 

11.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS  «2.  REPORT  DATE 

Directorate  of  Research  and  Analysis  December  1982 

Leadership  and  Management  Development  Denter  (ATC)  is.  number  of  pages 
Maxwell  Air  Force  Base,  Alabama  36112 _ 75 _ 

14.  MONITORING  AGENCY  NAME  4  AOORESSfM  dl  litre nt  Item  Controlling  Office)  IS.  SECURITY  CLASS,  (ot  thlm  report) 

Unclassified 


12.  REPORT  DATE 


15a.  DECLASSl  FI  CATION/ DOWN  GRADING 
SCHEDULE 


1 16.  DISTRIBUTION  STATEMENT  (ot  tbit  Report) 


Approved  for  public  release;  distribution  unlimited. 


[17.  DISTRIBUTION  STATEMENT  (ot  fh«  mbetrmct  Miwid  In  Block  20,  1/  different  from  Report) 


\  18.  SUPPLEMENTARY  NOTES 


[19.  KEY  WORDS  (Continu e  on  rtvtn*  aide  It  n«c««a«ry  and  identify  by  block  number) 


Attitudinal  survey  Factor  stability 

Organizational  Assessment  Package  Factor  structure 

OAP  Time  stability 

Survey 

Stability _ 

20.  ABSTRACT  (Conttn ua  on  revtree  old*  II  neceeeery  mid  Identity  by  block  number) 

>The  purpose  of  this  report  is  to  assess  the  stability  of  the  Organizational 
Assessment  Package  (OAP)  over  time.  Two  aspects  were  examined:  The  stability 
of  the  factor  structure  for  the  OAP  database  over  a  three  year  period,  and  the 
stability  of  the  OAP  factor  structure  when  administered  twice  to  the  same  indi¬ 
viduals  at  an  interval  of  six  months.  In  both  cases,  the  factor  structure  com¬ 
parison  was  by  inspection  of  item  content  and  coefficients  of  congruence.  Re¬ 
sults  showed  excellent  stability  for  the  factor  structure  of  the  OAP  database 
over  the  time  period  from  1979  to  1982.  Stability  was  less  strong  but  stilly 


od 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  rWi»n  Dele  Entered) 


UliHfcVnlJMi 


security  classification  of  this  paoiohm*  dm*  cmmmq 


Item  2J  continued?^ acceptable  for  the  Individuals  over  a  six  month  interval. 

The  results  support  the  use  of  the  OAP  database  for  identification  and  analysis 
of  systemic  trends,  as  well  as  consistency  In  the  management  consul tatlbn  process 
In  terms  of  factor  Interpretation. 


UNCLASSIFIED 


'FCIINITV  Cl  AMIFICATION  OF  THIS  PAOefTFhwi  DM*  Ent*r*4) 


Abstract 


The  purpose  of  this  report  Is  to  assess  the  stability  of  the  Organiza¬ 
tional  Assessment  Package  (OAP)  over  time.  Two  aspects  were  examined:  the 
stability  of  the  factor  structure  for  the  OAP  database  over  a  three  year 
period,  and  the  stability  of  the  OAP  factor  structure  when  administered  twice 
to  the  same  Individuals  at  an  Interval  of  six  months.  In  both  cases,  the 
factor  structure  comparison  was  by  inspection  of  Item  content  and  by  calcula¬ 
tion  of  coefficients  of  congruence.  Results  showed  excellent  stability  for 
the  factor  structure  of  the  OAP  database  over  the  time  period  from  1979  to 
1982.  Stability  was  less  strong  but  still  acceptable  for  the  Individuals 
over  a  six  month  Interval.  The  results  support  the  use  of  the  OAP  database 
for  Identification  and  analysis  of  systemic  trends,  as  well  as  consistency  in 
the  management  consultation  process  in  terms  of  factor  interpretation. 
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Background 

The  two  principal  questions  confronting  a  survey  instrument  are  those  of 
reliability  and  validity  (Isaac  &  Michael,  1971).  The  Organizational  Assess¬ 
ment  Package  (OAP)  has  been  the  subject  of  several  research  investigations 
addressing  the  reliability  and  validity  questions,  and  the  present  study  is 
an  extension  of  some  of  the  earlier  work.  Short  and  Hamilton  (1981)  examined 
OAP  reliability  using  both  the  test-retest  method  for  stability  and 
Cronbach's  alpha  for  internal  consistency  with  good  results.  Short  and 
Wilkerson  (1981)  supported  the  group  differences  aspects  of  OAP  construct 
validity  across  major  functional  area  groups.  Hightower  and  Short  (1982) 
demonstrated  the  consistency  of  the  OAP  factor  structure  across  major  func¬ 
tional  area  groups  as  well  as  a  variety  of  demographic  groups.  They  also 
found  factor  structure  consistency  for  the  OAP  between  the  pre-test  sample 
(the  OAP  administered  as  a  data -gathering  tool)  and  the  post-test  sample  (the 
OAP  administered  as  a  consulting  evaluation  tool). 

The  use  of  factor  analysis  for  evaluating  the  reliability  and  validity  of 
empirical  measures  is  discussed  by  Carmines  and  Zeller  (1979),  and  Lennon 
(1956)  mentions  it  specifically  in  connection  with  content  validity.  The 
present  study  addresses  a  type  of  factorial  invariance  which  Thurstone  (1947) 
calls  configurational  invariance  and  about  which  he  says,  "The  factor  load¬ 
ings  might  change  markedly  from  one  population  to  another;  but,  if  the  same 
test  battery  is  used  on  both  populations,  the  configuration  should  be  invari¬ 
ant.  As  a  matter  of  fact,  this  is  a  far  more  important  consideration  in  fac¬ 
tor  analysis  than  the  invariance  of  factor  loadings  (p.  365)."  Studies  of 


factor  Invariance,  or  stability,  over  time  can  be  used  to  detect  or  rule  out 
the  occurrence  of  beta  change,  apparent  change  complicated  by  measurement 
error  or  Instrument  recallbratlon.  The  Importance  of  determining  the 
stability  over  time  for  a  survey  Instrument  and  the  Implications  for 
measurement  of  change  In  organizational  research  have  been  addressed  In 
several  studies  (for  example,  Casclo,  1976;  Golemblewskl ,  Billingsley,  A 
Yeager,  1976;  Armenakls  A  Zmud,  1979;  Griffin,  1981).  Some  of  these  studies 
show  Invariance  of  factor  structure  over  time,  while  some  show  changes. 
Since  the  studies  used  different  Instruments,  different  samples,  and 
different  time  periods.  It  Is  not  possible  to  generalize  their  results. 

Purpose  of  the  Study 

The  purpose  of  the  current  study  was  to  examine  the  stability  of  the  OAP 
factor  structure  over  time.  One  aspect  of  this  was  to  look  for  changes  In 
the  factor  structure  over  the  three  year  history  of  OAP  administration.  The 
other  aspect  was  to  look  for  changes  In  the  factor  structure  when  the  OAP  was 
administered  twice  to  the  same  Individuals  at  an  Interval  of  six  months. 

Concerning  the  first  aspect,  factor  stability  of  the  OAP  over  the  longer 
time  period  (the  three  year  history  of  the  OAP  database)  Is  of  particular 
Importance  considering  the  use  of  the  database  for  research  on  systemic 
Issues  and  analysis  of  trends.  Also,  variations  In  the  OAP  factor  structure 
over  time  would  make  data-based  management  consultation  problematic  or  at 
least  more  complex.  Concerning  the  second  aspect,  stability  of  the  factor 
structure  over  the  six  month  Interval  between  administrations  becomes  a  cri¬ 
tical  Issue  because  the  OAP  Is  typically  administered  twice  in  an  organiza¬ 
tion.  The  first  time  for  diagnosis;  and  the  second  time  is  for  evaluation. 
If  there  Is  some  effect  on  factor  structure  simply  due  to  repeated  admini¬ 
stration  or  because  of  individual  change  during  the  time  period,  it  would  be 
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open  to  question  whether  observed  differences  following  consulting  were  due 
to  the  consulting  intervention  or  to  one  of  these  other  causes. 

In  addition  to  providing  information  useful  for  the  application  of  the 
current  OAP,  this  study  was  designed  to  provide  information  for  the  future 
OAP.  The  instrument  is  presently  being  completely  revised,  and  experience 
with  the  current  version  is  one  of  the  best  sources  of  guidance  for  the  revi- 


Method 


Instrumentation 

The  OAP  was  designed  and  developed  jointly  by  the  Air  Force  Human 
Resources  Laboratory  and  the  Leadership  and  Management  Development  Center, 
( LM5C)  and  Is  used  to  aid  LMDC  In  Its  mission  to:  (a)  provide  management 
consultation  service  to  Air  Force  commanders  on  request,  (b)  provide  leader¬ 
ship  and  management  training,  and  (c)  conduct  research  on  Air  Force  systemic 
issues  using  information  in  the  OAP  database.  The  OAP  is  a  survey  question¬ 
naire  consisting  of  16  demographic  items  and  93  attitudinal  items  (a  copy  of 
the  instrument  is  contained  in  Appendix  A).  Documentation  of  the  factor 
analysis  results  during  OAP  development  is  provided  in  Hendrix  and  Halverson 
(1979a;  1979b). 

In  the  LMDC  management  consultation  process,  the  initial  administration 
of  the  OAP  in  an  organization  is  a  key  step  in  the  data  gathering  process. 
The  survey  is  given  to  a  stratified  random  sample  of  the  personnel  in  the 
organization  to  which  LMDC  has  been  invited.  After  approximately  six  weeks 
for  analysis,  the  consultants  return  to  the  organization  for  the  tailored 
visit.  During  this  visit,  the  results  of  the  analysis  are  provided  to  com¬ 
manders  and  supervisors  in  the  organization.  The  results  are  handled  in  a 
confidential  manner  between  LMDC  and  the  client.  When  specific  problems  are 
identified,  a  consultant  and  supervisor  develop  a  management  action  plan 
designed  to  resolve  the  problem  at  that  level  of  the  organization. 
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Between  four  and  seven  months  after  the  tailored  visit,  the  consulting 
team  returns  to  the  organization  to  readminister  the  OAP  and  do  other 
followup  data  gathering.  In  this  case,  the  OAP  is  used  as  an  evaluation  tool 
to  help  assess  the  impact  of  the  consulting  process.  After  analysis,  a  final 
report  and  the  results  of  comparing  pre-  and  post-  OAP  administrations  are 
mailed  to  the  client  organization. 

The  data  from  OAP  administrations  are  stored  in  a  cumulative  database 
containing  over  100,000  pre-  and  post-  records  at  the  time  of  this  study.  In 
addition  to  the  16  demographic  items,  other  demographics  stored  on  each 
record  include  work  group  code,  personnel  category  and  pay  grade,  age,  sex. 
Air  Force  Specialty  Code,  base,  and  major  command.  In  addition  to  supporting 
the  consultation  process,  the  database  is  used  to  conduct  research  on  Air 
Force-wide  issues  related  to  leadership  and  management. 

Samples 

To  examine  the  first  area  of  concern,  the  stability  of  the  OAP  factor 
structure  over  the  three  year  period  of  OAP  administration,  responses  to  the 
pre-intervention  OAP  were  drawn  from  the  database  and  divided  chronologically 
into  five  approximately  equal  fractions.  (Note:  the  database  is  actually 
stored  in  two  computer  files,  one  a  history  file  of  1979  records,  and  the 
other  file  containing  records  from  all  administrations  since  1  Janiary  1980.) 
This  chronological  breakdown  is  shown  in  Table  1  along  with  sample  sizes  for 
each  fraction,  and  number  of  bases  and  number  of  major  commands  (MAJCOMs) 
represented  in  each  fraction.  Demographic  information  (age,  sex,  personnel 
category,  time  in  service,  and  major  functional  area)  for  each  fraction  is 


,±.m.r 


given  in  Appendix  B.  The  demographic  information  is  provided  simply  to  char¬ 
acterize  the  sample  fractions,  not  as  an  alternative  explanation  for  any 
between-fraction  differences  which  might  be  found.  The  QAP  factor  structure 
has  been  shown  to  be  very  stable  across  demographic  groups  (Hightower  & 
Short,  1982). 

To  examine  the  second  area  of  concern,  the  stability  of  the  instrument 
for  individuals  over  the  typical  time  period  between  QAP  administrations,  the 
sample  was  drawn  from  the  control  group  for  another  study  (Austin  &  Schunk, 
1981).  The  sample  consisted  of  individuals  who  had  taken  the  QAP  twice  at  a 
six  month  interval  and  whose  matched  Time  1-Time  2  responses  were  available. 
Since  the  sample  came  from  a  control  group,  there  was  no  intervention  between 
the  two  OAP  administrations.  The  procedure  for  matching  Time  1  and  Time  2 
records  is  described  in  Short  &  Hamilton  (1981).  There  were  293  individuals 
in  the  Time  1  administration  and  330  individuals  in  the  Time  2  administration 
who  responded  to  all  93  attitudinal  items. 
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Table  1 


Description  of  Sample  Fractions  for  Three  Year  Study 


Calendar  Number  Number 


Fraction 

Year/Quarters 

_N  _ 

Hl 

of  Bases 

of  MAJCOMs 

1 

1979/2,3,4 

22,045 

12,682 

27 

7 

2 

1980/1,2 

21,726 

13,125 

35 

9 

3 

1980/3,4 

17,602 

10,080 

22 

6 

4 

1981/1 

16,199 

9,047 

12 

3 

5 

1981/2,3,4 

1982/1 

17,036 

8,471 

27 

7 

Note:  N  is  the  total  number  of  individual  OAP  cases  and  Ni  is  the  number 
of  individuals  represented  in  the  factor  analysis.  Nj  Is  smaller 
than  N  because  the  factor  analysis  procedure  used  only  cases  which  had 
responses  other  than  zero  for  all  93  attitudlnal  Items. 
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For  each  of  the  five  chronological  fractions  and  for  the  Time  1  and  Time 
2  responses  of  the  matched  Individuals,  principal  component  analyses  were 
accomplished  with  a  principal  factor  solution  (Is  on  the  main  diagonal  of  the 
correlation  matrix)  using  a  varimax  rotation  from  the  procedures  contained  In 
the  Statistical  Package  for  the  Social  Sciences  (SPSS)  (Nle,  Hull,  Jenkins, 
Steinbrenner  &  Bent,  1975).  The  minimum  eigenvalue  for  factors  extracted  was 
1.0.  For  each  factor  analysis,  the  variables  were  the  item  responses  for  the 
93  attitudinal  items  on  the  OAP.  Selection  of  the  factoring  technique  was 
based  on  the  premises  that  the  principal  factor  procedure  does  not  require 
prior  assumptions  about  the  underlying  structure  (Nie,  et  al ,  1975),  is  the 
most  widely  used  (Marradi ,  1981),  and  is  appropriate  when  the  purpose  is  to 
determine  the  minimum  number  of  Independent  dimensions  accounting  for  the 
maximum  amount  of  variance  (Cooley  &  Lohnes,  1971). 

The  factor  loading  comparisons  were  accomplished  by  Inspection  of  the 
factor  loading  patterns  and  by  calculation  of  coefficients  of  congruence 
(Harman,  1967).  Congruence  coefficients  were  selected  because  they  are  wide¬ 
ly  used  (Levine,  1977),  they  have  an  approximate  test  of  significance  (Korth 
&  Tucker,  1975),  and  because  previous  analysis  of  groups  in  the  OAP  database 
showed  consistent  results  for  coefficient  of  congruence,  root  mean  square, 

and  s-index  procedures  (Hightower  &  Short,  1982).  The  factor  loading 

*  . 

matrices  produced  by  the  SPSS  factor  analysis  procedure  were  used  as  input 
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data  for  a  computer  program  which  calculated  the  congruence  coefficients. 
For  the  three  year  study,  all  of  the  ten  possible  pairs  of  the  factor  solu¬ 
tions  for  the  five  fractions  were  compared.  For  the  six  month  study  of 
matched  Individuals,  the  comparison  was  simply  between  Time  1  and  Time  2. 
For  each  pair  of  factor  loading  matrices  compared,  congruence  coefficients 
were  calculated  for  all  possible  factor  pairs  between  the  two  solutions. 
Matching  factors  are  those  with  the  largest  congruence  coefficient  (absolute 
value).  It  should  also  be  noted  that  the  program  truncates  (rather  than 
rounds)  the  congruence  coefficients,  so  the  results  are  conservative. 

Results 

The  number  of  factors  extracted  for  each  group  and  the  percent  of  vari¬ 
ance  explained  by  the  factor  solution  is  shown  in  Table  2.  For  each  group, 
13  of  the  factors  were  interpretable  by  examination  of  the  pattern  and  magni¬ 
tude  of  the  factor  loadings.  The  literature  on  factor  analysis  contains 
extensive  discussion  of  the  number  of  factors  to  interpret  compared  to  the 
number  of  factors  extracted  (for  example,  Marradi ,  1981;  Hair,  Anderson, 
Tatham,  &  Grablowsky,  1979;  Guilford,  1952).  Factors  with  small  eigenvalues 
may  consist  of  little  more  than  error  variance.  For  the  purpose  of  this 
report,  factors  which  did  not  contain  the  primary  loading  of  at  least  two 
variables  were  classed  as  uninterpretable.  The  interpretable  factors  are 
listed  for  the  two  studies  in  Tables  3  and  4  along  with  the  percent  of  vari¬ 
ance  explained  by  each  factor  for  each  group. 
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Table  2 
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Table  3 


Percent  Of  Variance  Explained  By  Each  Factor 
Three  Year  Study 


Factor  Fraction  1  Fraction  2  Fraction  3  Fraction  4  Fraction  5 


Supervision 

30.4 

30.6 

29.5 

29.8 

28.8 

Organizational  Climate 

6.8 

7.2 

7.1 

6.5 

7.1 

Work  Group  Effectiveness 

4.9 

3.1 

3.2 

5.0 

5.1 

Task  Characteristics 

3.2 

5.0 

4.8 

2.7 

3.1 

Job  Role  Pride  &  Satisfaction 

2.8 

2.7 

2.8 

3.2 

2.7 

Need  For  Enrichment 

2.7 

2.8 

3.0 

2.8 

2.9 

Task  Autonomy 

2.4 

2.4 

2.5 

2.3 

2.5 

Job  Performance  Goals 

1.9 

1.9 

1.9 

1.8 

2.0 

Advancement/Recognition 

1.8 

1.8 

1.8 

1.8 

1.8 

Work  Support 

1.5 

1.5 

1.5 

1.6 

1.6 

Work  Interference 

1.4 

1.4 

1.4 

1.5 

1.5 

Work  Repetition 

1.2 

1.2 

1.2 

1.3 

1.3 

Desired  Repetitive  Easy  Tasks 

1.2 

1.2 

1.2 

1.2 

1.2 

NOTE:  Factors  named  based  on  Item  content 


Table  4 

Percent  Of  Variance  Explained  By  Each  Factor 
Time  1  -  Time  2  Study 


Factor 

Time  1 

Time  2 

Supervision 

35.4 

38.7 

Organizational  Climate 

6.3 

6.9 

Work  Group  Effectiveness 

3.9 

2.7 

Task  Characteristics 

1.7 

5.9 

Job  Role  Pride  and  Satisfaction 

1.6 

1.2 

Need  For  Enrichment 

2.7 

3.4 

Task  Autonomy 

5.3 

2.2 

Job  Performance  Goals 

2.4 

1.9 

Advancement/Recognition 

2.1 

1.7 

Work  Support 

1.5 

1.6 

Work  Interference 

1.4 

1.3 

Work  Repetition 

1.4 

1.4 

Desired  Repetitive  Easy  Tasks 

1.3 

1.2 

NOTE:  Factors  named  based  on  item  content. 


Factor-by-factor  comparisons  of  Item  content  for  both  studies  are  shown 
In  the  tables  In  Appendix  D.  The  tables  contain  the  primary  (highest)  load¬ 
ing  of  each  Item  In  each  solution.  For  the  sake  of  completeness,  secondary 
loadings  are  given  In  parentheses  for  the  cases  where  that  Item  In  another 
solution  had  Its  primary  loading  on  that  factor.  In  general,  what  this  Indi¬ 
cates  Is  an  Item  with  a  high  secondary  loading  and  a  resultant  tendency  to 
shift  from  one  factor  to  another  depending  on  the  group  being  analyzed.  Even 
among  the  secondary  loadings,  there  are  few  loadings  below  .30.  Examination 
of  the  Item  content  of  the  factors  for  the  three  year  study  (Appendix  D, 
Tables  1-13)  shows  good  consistency  among  the  chronological  fractions  with  no 
apparent  time-related  trends.  Examination  of  the  tables  for  the  Time  1  - 
Time  2  study  (Appendix  D,  tables  14-26)  seems  to  show  somewhat  less  stability 
in  the  item  content  of  factors  for  Individuals  over  a  six  month  period. 
Based  on  previous  experience  with  factor  analysis  using  small  samples  and  on 
recommendations  in  the  literature  concerning  sample  size.  It  seems  likely 
that  at  least  part  of  the  apparent  difference  is  due  to  sample  size.  Hair, 
Anderson,  Tatham,  and  Grablowsky  (1979)  urge  caution  in  any  analysis  where 
there  are  not  at  least  four  or  five  times  as  many  observations  as  variables. 
In  the  Time  1  -  Time  2  study,  there  were  293  observations  for  Time  1,  330 
observations  for  Time  2,  and  93  variables,  for  ratios  closer  to  3:1. 

The  item  content  results  are  supported  by  the  results  from  calculation  of 
coefficients  of  congruence.  Appendix  E  contains  the  coefficients  for  both 
studies.  Tables  1-10  show  results  for  each  fraction  In  the  three  year  study 
compared  with  every  other  fraction.  Factor  pairs  with  the  highest  congruence 


coefficient  are  also  factor  pairs  which  match  on  the  basis  of  Item  content. 
For  the  three  year  study,  the  values  of  the  congruence  coefficients  for 
matching  factors  range  between  .96  and  .99.  Table  11  In  Appendix  E  shows  the 
calculated  congruence  coefficients  for  the  Time  1  -  Time  2  comparison. 
Again,  factors  which  match  based  on  Item  content  also  have  the  highest  con¬ 
gruence  coefficients.  For  the  Time  1  -  Time  2  study,  coefficients  for  match¬ 
ing  factors  range  between  .79  and  .98. 

The  previously  mentioned  test  for  statistical  significance  of  congruence 
coefficients  Is  based  on  a  simulation  study  by  Korth  and  Tucker  (1975). 
Using  the  tables  they  developed,  minimum  values  for  statistical  significance 
of  the  congruence  coefficients  In  the  present  study  were  calculated  and  are 
contained  In  Appendix  F.  Even  when  the  most  conservative  estimates  are  used 
to  account  for  number  of  variables,  order  of  factor  matching,  number  of  fac¬ 
tors,  and  In  the  choice  of  ^  -  values,  all  the  congruence  coefficients  for 
matching  factors  In  both  the  three  year  study  and  the  Time  1  -  Time  2  study 
are  significant  at  the  .01  level. 

Discussion  and  Conclusions 

The  results  of  both  Item  content  of  factors  and  congruence  coefficients 
for  the  three  year  study  show  good  stability  of  the  OAP  factor  structure 
across  the  chronological  fractions.  There  are  some  differences  in  factor 
Item  content  among  the  fractions,  but  these  differences  are  minor  and  show  no 
apparent  trends  over  time.  Congruence  coefficients  are  uniformly  high  for 
matching  factors.  The  stability  of  the  OAP  factor  structure  over  three  years 
supports  the  use  of  this  database  for  Identification  and  analysis  of  systemic 
trends. 
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Stability  of  factor  structure  is  less  strong  but  still  acceptable  in  the 
case  of  the  Time  1  -  Time  2  study,  particularly  in  view  of  the  small  sample 
size.  The  stability  found  is  perhaps  not  surprising  in  light  of  the  results 
of  the  reliability  study  with  the  same  data  (Short  &  Hamilton,  1981).  How¬ 
ever,  the  factor  structure  in  the  current  study  is  somewhat  different  than 
that  used  for  the  reliability  study.  As  already  noted,  pre- intervention  fac¬ 
tor  structure  and  post-intervention  factor  structure  for  the  CAP  database 
were  compared  by  Hightower  and  Short  (1982).  Strong  similarity  of  factor 
structures  were  reported,  but  this  result  was  based  on  a  comparison  of  all 
pre- inter vent  ion  data  with  all  post-intervention  data.  Because  of  the  per¬ 
sonnel  turnover  in  organizations,  the  stratified  random  sampling  techniques 
used  for  selecting  respondents  within  an  organization,  and  the  fact  that  the 
pre-database  always  leads  the  post-database,  it  was  not  known  how  many  of  the 
respondents  were  in  both  the  pre-sample  and  the  post-sample.  To  look  at  fac¬ 
tor  structure  stability  over  time  with  the  same  individuals,  therefore,  a 
different  sample  was  needed.  By  using  a  control  group  for  this  sample,  the 
possibility  of  factor  structure  change  due  to  an  intervention  could  be  elimi¬ 
nated.  A  larger  sample  would  have  been  preferable,  but  the  analysis  was  con¬ 
ducted  on  the  only  appropriate  sample  available.  The  results  unambiguously 
demonstrate  the  existance  of  a  consistent  factor  structure  for  individuals 
over  a  six  month  period.  And  stability  for  individuals  supports  the  use  of 
the  QAP  as  an  evaluation  tool  by  eliminating  the  possibility  that  observed 
factor  score  changes  are  simply  the  result  of  a  change  in  factor  structure. 


In  relation  to  the  other  purpose  of  the  study,  to  gather  Information 
useful  for  the  revision  of  the  OAP.  a  further  look  at  the  Item  content  of 
factors  In  the  three  year  study  provides  some  Insight.  Across  the  five  frac¬ 
tions  analyzed.  Items  can  be  classed  In  one  of  the  following  three  cate¬ 
gories: 

Category  A:  Items  which  consistently  have  strong  primary 
loadings  on  a  single  factor.  The  majority  of 
OAP  Items  (81  out  of  93)  are  In  Category  A. 

Category  B:  Items  which  consistently  have  primary  loadings 
on  one  factor,  but  appear  to  have  markedly 
lower  loadings  than  the  other  Items  in  that 
factor.  Seven  of  the  OAP  Items  fall  Into 
Category  B. 

Category  C:  Items  which  have  primary  loadings  on  more  than 

one  factor,  depending  on  the  group  being  analyzed. 

Five  of  the  OAP  Items  fall  Into  Category  C. 

The  Category  B  Items  are  listed  In  Table  5,  and  the  Category  C  items  in 
Table  6.  Based  on  the  factor  analysis  results.  Items  In  both  categories 
should  be  considered  candidates  for  elimination  In  the  absence  of  overriding 
consulting  needs.  The  literature  strongly  indicates  that  complex  variables 
(variables  which  make  substantial  contributions  to  more  that  one  factor) 
should  be  avoided  (for  example.  Guilford.  1952;  Comrey,  1978).  Before  decid¬ 
ing  to  drop  an  Item,  an  analysis  could  be  performed  to  check  for  the  contri¬ 
bution  of  the  Item  to  factor  reliability,  although  for  Category  C  items  it 
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is  not  clear  which  factor  to  check.  If  the  items  are  retained,  there  seems 
to  be  a  case  for  trying  to  reword  some  of  them.  For  example,  one  of  the 
Category  B  items  is  V279,  and  experience  indicates  that  many  respondents  are 
not  clear  about  the  use  of  the  word  "bottleneck"  in  this  item.  Another  Cate¬ 
gory  B  item,  V209,  appears  to  ask  two  questions.  Also,  four  of  the  nine 
items  having  the  format  of  the  700-series  satisfaction  items  are  classed  as 
Category  B  or  Category  C. 

In  summary,  the  results  of  this  study  of  the  temporal  stability  of  the 
OAP  factor  structure  lend  strong  support  to  the  use  of  the  GAP  database  in 
analysis  of  systemic  Issues  and  to  the  use  of  the  GAP  as  both  a  data 
gathering  and  evaluation  tool  in  the  management  consultation  process. 
Current  results  are  particularly  strong  when  combined  with  results  of 
previous  studies.  In  addition,  information  presented  about  specific  items 
should  be  useful  in  the  effort  to  revise  the  OAP. 


Category  B  Items  -  Three  Year  Study 


Work  Interference  V279  To  what  extent  does  a  bottleneck  in  your 

organization  seriously  affect  the  flow  of 
work  either  to  or  from  your  group? 
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GENERAL  INFORMATION 


The  leaders  of  your  organization  are  genuinely  Interested  In  Improving  the 
overall  conditions  within  their  areas  of  responsibility.  Providing  a  more 
satisfying  Air  Force  way  of  life  and  Increasing  organizational  effectiveness 
are  also  goals.  One  method  of  reaching  these  goals  Is  by  continual  refine¬ 
ment  of  the  management  processes  of  the  Air  Force.  Areas  of  concern  Include 
job  related  issues  such  as  leadership  and  management;  training  and  utiliza¬ 
tion;  motivation  of  and  concern  for  people;  and  the  communication  process. 

This  survey  is  Intended  to  provide  a  means  of  Identifying  areas  within  your 
organization  needing  the  greatest  emphasis  in  the  immediate  future.  You  will 
be  asked  questions  about  your  job,  work  group,  supervisor,  and  organization. 
For  the  results  to  be  useful,  it  is  important  that  you  respond  to  each  state¬ 
ment  thoughtfully,  honestly,  and  as  frankly  as  possible.  Remember,  this  Is 
not  a  test,  there  are  no  right  or  wrong  responses. 

Your  completed  response  sheet  will  be  processed  by  automated  equipment,  and 
be  summarized  in  statistical  form.  Your  individual  response  will  remain  con¬ 
fidential,  as  it  will  be  combined  with  the  responses  of  many  other  persons, 
and  used  for  organizational  feedback  and  possibly  Air  Force  wide  studies. 


KEY  WORDS 

The  following  should  be  considered  as  key  words  throughout  the  survey: 

—  Supervisor:  The  person  to  whom  you  report  directly. 

--  Work  Group:  All  persons  who  report  to  the  same  supervisor  that  you 
do. 

--  Organization:  Your  squadron.  However,  if  you  work  in  staff/support 
agencies,  the  division  or  directorate  would  be  your 
organization. 


INSTRUCTIONS 


1.  All  statements  may  be  answered  by  filling  In  the  appropriate  spaces  on 
the  response  sheet  provided.  If  you  do  not  find  a  response  that  fits  your 
case  exactly,  use  the  one  that  Is  the  closest  to  the  way  you  feel. 

2.  Be  sure  that  you  have  completed  Section  1  of  the  response  sheet,  as 
Instructed  by  the  survey  administrator,  before  beginning  Section  2. 

3.  Please  use  the  pencil  provided,  and  observe  the  following: 

—Make  heavy  black  marks  that  fill  the  spaces. 

—Erase  cleanly  any  responses  you  wish  to  change. 

—Make  no  stray  markings  of  any  kind  on  the  response  sheet. 

—Do  not  staple,  fold  or  tear  the  response  sheet. 

--Do  not  make  any  markings  on  the  survey  booklet. 

4.  The  response  sheet  has  a  0-7  scale.  The  survey  statements  normally 
require  a  1-7  response.  Use  the  zero  (0)  response  only  If  the  statement 
truly  does  not  apply  to  your  situation.  Statements  are  responded  to  by 
marking  the  appropriate  space  on  the  response  sheet  as  In  the  following 
example: 

Using  the  scale  below,  evaluate  the  sample  statement. 

1  =  Strongly  disagree  5  »  Slightly  agree 

2  =  Moderately  disagree  6  =  Moderately  agree 

3  *  Slightly  disagree  7  *  Strongly  agree 

4  *  Neither  agree  nor  disagree 

Sample  Statement.  The  Information  your  work  group  receives  from  other  work 

groups  Is  helpful. 

If  you  moderately  agree  with  the  sample  statement,  you  would  blacken  the  oval 
(6)  on  the  response  sheet. 

NA 

Sample  Response:  (0)  (1)  (2)  (3)  (4)  (5)  (6)  (7) 


5.  When  you  have  completed  the  survey,  please  turn  In  the  survey  materials 
as  instructed  in  the  Introduction. 
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BACKGROUND  INFORMATION 


This  section  of  the  survey  concerns  your  background.  The  Information 
requested  Is  to  Insure  that  the  groups  you  belong  to  are  accurately  repre¬ 
sented  and  not  to  Identify  you  as  an  Individual.  Please  use  the  separate 
response  sheet  and  darken  the  oval  mhlch  corresponds  to  your  response  to  each 
question. 

1.  Total  years  In  the  Air  Force: 

1.  Less  than  1  year. 

2.  More  than  1  year,  less  than  2  years 

3.  More  than  2  years,  less  than  3  years. 

4.  More  than  3  years,  less  than  4  years. 

5.  More  than  4  years,  less  than  8  years. 

6.  More  than  8  years,  less  than  12  years. 

7.  More  than  12  years. 

2.  Total  months  in  present  career  field. 

1.  Less  than  1  month. 

2.  More  than  1  month,  less  than  6  months. 

3.  More  than  6  months,  less  than  12  months. 

4.  More  than  12  months,  less  than  18  months. 

5.  More  than  18  months,  less  than  24  months. 

6.  More  than  24  months,  less  than  36  months. 

7.  More  than  36  months. 

3.  Total  months  at  this  station: 

1.  Less  than  1  month. 

2.  More  than  1  month,  less  than  6  months. 

3.  More  than  6  months,  less  than  12  months. 

4.  More  than  12  months,  less  than  18  months. 

5.  More  than  18  months,  less  than  24  months. 

6.  More  than  24  months,  less  than  36  months. 

7.  More  than  36  months. 

4.  Total  months  in  present  position: 

1.  Less  than  1  month. 

2.  More  than  1  months,  less  than  6  months. 

3.  More  than  6  months,  less  than  12  months. 

4.  More  than  12  months,  less  than  18  months. 

5.  More  than  18  months,  less  than  24  months. 

6.  More  than  24  months,  less  than  36  months. 

7.  More  than  36  months. 


5.  Your  Ethnic  Group  Is: 


1.  American  Indian  or  Alaskan  Native 

2.  Aslan  or  Pacific  Islander 

3.  Black,  not  of  Hispanic  Origin 

4.  Hispanic 

5.  White,  not  of  Hispanic  Origin 

6.  Other 

6.  Your  highest  education  level  attained  Is: 

1.  Non-high  school  graduate 

2.  High  school  graduate  or  GED 

3.  Less  than  two  years  college 

4.  Two  years  or  more  college 

5.  Bachelors  Degree 

6.  Masters  Degree 

7.  Doctoral  Degree 

7.  Highest  level  of  professional  military  education  (residence  or 
correspondence) : 

0.  None  or  not  applicable 

1.  NCO  Orientation  Course  or  USAF  Supervisor  Course  (NCO  Phase  1  or  2) 

2.  NCO  Leadership  School  (NCO  Phase  3) 

3.  NCO  Academy  (NCO  Phase  4) 

4.  Senior  NCO  Academy  (NCO  Phase  5) 

5.  Squadron  Officer  School 

6.  Intermediate  Service  School  (l.e.,  ACSC,  AFSC) 

7.  Senior  Service  School  (l.e.,  AWC,  ICAF,  NWC) 

8.  How  many  people  do  you  directly  supervise? 

1.  None  4.  3 

2.  1  5.  4  to  5 

3.  2  6.  6  to  8 

7.  9  or  more 

9.  For  how  many  people  do  you  write  performance  reports? 

1.  None  4.  3 

2.  1  5.  4  to  5 

3.  2  6.  6  to  8 

7.  9  or  more 

10.  Does  your  supervisor  actually  write  your  performance  reports? 

1.  yes  2.  no 


3.  not  sure 


11.  Which  of  the  following  "best"  describes  your  marital  status? 

0.  Not  Married 

1.  Married:  Spouse  Is  a  civilian  employed  outside  home. 

2.  Married:  Spouse  Is  a  civilian  employed  outside  home-geographical ly 
separated. 

3.  Married:  Spouse  not  employed  outside  home. 

4.  Married:  Spouse  not  employed  outside  home-geographical ly  separated. 

5.  Married:  Spouse  Is  a  military  member. 

6.  Married:  Spouse  Is  a  military  member-geographical ly  separated. 

7.  Single  Parent. 

12.  What  Is  your  usual  work  schedule? 

1.  Day  shift,  normally  stable  hours. 

2.  Swing  shift  (about  1600-2400) 

3.  Mid  shift  (about  2400-0800) 

4.  Rotating  shift  schedule 

5.  Day  or  shift  work  with  irregular/unstable  hours. 

6.  Frequent  TDY/travel  or  frequently  on-call  to  report  to  work. 

7.  Crew  schedule. 

13.  How  often  does  your  supervisor  hold  group  meetings? 

1.  Never  4.  Weekly 

2.  Occasionally  5.  Dally 

3.  Monthly  6.  Continuously 

14.  How  often  are  group  meetings  used  to  solve  problems  and  establish  goals? 

1.  Never  3.  About  half  the  time 

2.  Occasionally  4.  All  of  the  time 

15.  What  is  your  aeronautical  rating  and  current  status? 

1.  Nonrated,  not  on  aircrew  3.  Rated,  In  crew/ operations  job 

2.  Nonrated,  now  on  aircrew  4.  Rated,  in  support  job 

16.  Which  of  the  following  best  describes  your  career  or  employment  inten¬ 
tions? 

1.  Planning  to  retire  in  the  next  12  months 

2.  Will  continue  in/with  the  Air  Force  as  a  career 

3.  Will  most  likely  continue  In/with  the  Air  Force  as  a  career 

4.  May  continue  in/with  the  Air  Force 

5.  Will  most  likely  not  make  the  Air  Force  a  career 

6.  Will  separate/terminate  from  the  Air  Force  as  soon  as  possible 


JOB  INVENTORY 


Below  are  Items  which  relate  to  your  job.  Read  each  statement  carefully  and 
then  decide  to  what  extent  the  statement  Is  true  of  your  job.  Indicate  the 
extent  to  which  the  statement  Is  true  for  your  job  by  choosing  the  phrase 
which  best  represents  your  job. 

1  ■  Hot  at  all  5  ■  To  a  fairly  large  extent 

2  ■  To  a  very  little  extent  6  »  To  a  great  extent 

3  *  To  a  little  extent  7  ■  To  a  very  great  extent 

4  *  To  a  moderate  extent 

Select  the  corresponding  number  for  each  question  and  enter  It  on  the 
separate  response  sheet. 


17.  To  what  extent  does  your  job  require  you  to  do  many  different  things, 
using  a  variety  of  your  talents  and  skills? 

18.  To  what  extent  does  your  job  involve  doing  a  whole  task  or  unit  of  work? 

19.  To  what  extent  is  your  job  significant,  in  that  it  affects  others  in 
some  Important  way? 

20.  To  what  extent  does  your  job  provide  a  great  deal  of  freedom  and  inde¬ 
pendence  in  scheduling  your  work? 

21.  To  what  extent  does  your  job  provide  a  great  deal  of  freedom  and  inde¬ 
pendence  in  selecting  your  own  procedures  to  accomplish  it? 

22.  To  what  extent  are  you  able  to  determine  how  well  you  are  doing  your  job 
without  feedback  from  anyone  else? 

23.  To  what  extent  do  additional  duties  interfere  with  the  performance  of 
your  primary  job? 

24.  To  what  extent  do  you  have  adequate  tools  and  equipment  to  accomplish 
your  job? 

25.  To  what  extent  Is  the  amount  of  work  space  provided  adequate? 

26.  To  what  extent  does  your  job  provide  the  chance  to  know  for  yourself 

when  you  do  a  good  job,  and  to  be  responsible  for  your  own  work? 

27.  To  what  extent  does  doing  your  job  well  affect  a  lot  of  people? 

28.  To  what  extent  does  your  job  provide  you  with  the  chance  to  finish  com¬ 

pletely  the  piece  of  work  you  have  begun? 
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1  -  Not  at  all  5  =  To  a  fairly  large  extent 

2  »  To  a  very  little  extent  6  »  To  a  great  extent 

3  *  To  a  little  extent  7  ■  To  a  very  great  extent 

4  ■  To  a  moderate  extent 

29.  To  what  extent  does  your  job  require  you  to  use  a  number  of  complex 
skills? 

30.  To  what  extent  does  your  job  give  you  freedom  to  do  your  work  as  you  see 
fit? 

31.  To  what  extent  are  you  allowed  to  make  the  major  decisions  required  to 
perform  your  job  well? 

32.  To  what  extent  are  you  proud  of  your  job? 

33.  To  what  extent  do  you  feel  accountable  to  your  supervisor  In  accomplish¬ 
ing  your  job? 

34.  To  what  extent  do  you  know  exactly  what  is  expected  of  you  in  performing 
your  job? 

35.  To  what  extent  are  your  job  performance  goals  difficult  to  accomplish? 

36.  To  what  extent  are  your  job  performance  goals  clear? 

37.  To  what  extent  are  your  job  performance  goals  specific? 

38.  To  what  extent  are  your  job  performance  goals  realistic? 

39.  To  what  extent  do  you  perform  the  same  tasks  repeatedly  within  a  short 
period  of  time? 

40.  To  what  extent  are  you  faced  with  the  same  type  of  problem  on  a  weekly 
basis? 

41.  To  what  extent  are  you  aware  of  promotion /advancement  opportunities  that 
affect  you? 

42.  To  what  extent  do  co-workers  in  your  work  group  maintain  high  standards 
of  performance? 

43.  To  what  extent  do  you  have  the  opportunity  to  progress  up  your  career 
ladder? 

44.  To  what  extent  are  you  being  prepared  to  accept  increased  responsibil¬ 
ity? 

45.  To  what  extent  do  people  who  perform  well  receive  recognition? 

46.  To  what  extent  does  your  work  give  you  a  feeling  of  pride? 
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5  ■  To  a  fairly  large  extent 

6  ■  To  a  great  extent 

7  =  To  a  very  great  extent 


1  -  Not  at  all 

2  ■  To  a  very  little  extent 

3  =  To  a  little  extent 

4  »  To  a  moderate  extent 

47.  To  what  extent  do  you  have  the  opportunity  to  learn  skills  which  will 
Improve  your  promotion  potential? 

48.  To  what  extent  do  you  have  the  necessary  supplies  to  accomplish  your 
job? 

49.  To  what  extent  do  details  (tasks  not  covered  by  primary  or  additional 
duty  descriptions)  Interfere  with  the  performance  of  your  primary  job? 

50.  To  what  extent  does  a  bottleneck  In  your  organization  seriously  affect 
the  flow  of  work  either  to  or  from  your  group? 


JOB  DESIRES 

The  statements  below  deal  with  job  related  characteristics.  Read  each  state¬ 
ment  and  choose  the  response  which  best  represents  how  much  you  would  like  to 
have  each  characteristic  In  your  job. 

In  my  job,  I  would  like  to  have  the  characteristics  described: 

1  =  Not  at  all  5  *  A  large  amount 

2  =  A  slight  amount  6  =  A  very  large  amount 

3  =  A  moderate  amount  7  -  An  extremely  large  amount 

4  *  A  fairly  large  amount 


51.  Opportunities  to  have  Independence  in  my  work. 

52.  A  job  that  Is  meaningful. 


53.  An  opportunity  for  personal  growth  in  my  job. 

54.  Opportunities  in  my  work  to  use  my  skills. 

55.  Opportunities  to  perform  a  variety  of  tasks. 

56.  A  job  in  which  tasks  are  repetitive. 

57.  A  job  in  which  tasks  are  relatively  easy  to  accomplish. 


SUPERVISION 


The  statements  below  describe  characteristics  of  managers  or  supervisors. 
Indicate  your  agreement  by  choosing  the  phrase  which  best  represents  your 
attitude  concerning  your  supervisor. 

1  =  Strongly  disagree  5  =  Slightly  agree 

2  *  Moderately  disagree  6  =  Moderately  agree 

3  =  Slightly  disagree  7  »  Strongly  agree 

4  =  Neither  agree  nor  disagree 

Select  the  corresponding  number  for  each  statement  and  enter  It  on  the 
separate  response  sheet. 

58.  My  supervisor  Is  a  good  planner. 

59.  My  supervisor  sets  high  performance  standards. 

60.  My  supervisor  encourages  teamwork. 

61.  My  supervisor  represents  the  group  at  all  times. 

62.  My  supervisor  establishes  good  work  procedures. 

63.  My  supervisor  has  made  his  responsibilities  clear  to  the  group. 

64.  My  supervisor  fully  explains  procedures  to  each  group  member. 

65.  My  supervisor  performs  well  under  pressure. 

66.  My  supervisor  takes  time  to  help  me  when  needed. 

67.  My  supervisor  asks  members  for  their  ideas  on  task  improvements. 

68.  My  supervisor  explains  how  my  job  contributes  to  the  overall  mission. 

69.  My  supervisor  helps  me  set  specific  goals. 

70.  My  supervisor  lets  me  know  when  I  am  doing  a  good  job. 

71.  My  supervisor  lets  me  know  when  I  am  doing  a  poor  job. 

72.  My  supervisor  always  helps  me  improve  my  performance. 

73.  My  supervisor  insures  that  I  get  job  related  training  when  needed. 

74.  My  job  performance  has  Improved  due  to  feedback  received  from  my  super¬ 
visor. 
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75.  When  I  need  technical  advice,  I  usually  go  to  my  supervisor. 

76.  My  supervisor  frequently  gives  me  feedback  on  how  well  I  am  doing  my 
job. 

WORK  GROUP  PRODUCTIVITY 

The  statements  below  deal  with  the  output  of  your  work  group.  The  term  "your 
work  group"  refers  to  you  and  your  co-workers  who  work  for  the  same  supervi¬ 
sor.  Indicate  your  agreement  with  the  statement  by  selecting  the  phrase 
which  best  expresses  your  opinion. 


1  =  Strongly  disagree 

2  =  Moderately  disagree 

3  =  Slightly  disagree 


4  =  Neither  agree  nor  disagree 

5  =  Slightly  agree 

6  =  Moderately  agree 

7  =  Strongly  agree 


Select  the  corresponding  number  for  each  statement  and  enter  it  on  the 
separate  response  sheet. 

77.  The  quantity  of  output  of  your  work  group  is  very  high. 

78.  The  qual ity  of  output  of  your  work  group  is  very  high. 

79.  When  high  priority  work  arises,  such  as  short  suspenses,  crash  programs, 
and  schedule  changes,  the  people  in  my  work  group  do  an  outstanding  job 
in  handling  these  situations. 

80.  Your  work  group  always  gets  maximum  output  from  available  resources 
(e.g.,  personnel  and  material). 

81.  Your  work  group's  performance  in  comparison  to  similar  work  groups  is 
very  high. 

ORGANIZATION  CLIMATE 

Below  are  items  which  describe  chara  teristics  of  your  organization.  The 
term  "your  organization"  refers  to  your  squadron  or  staff  agency.  Indicate 
your  agreement  by  choosing  the  phrase  which  best  represents  your  opinion 
concerning  your  organization. 


1  =  Strongly  disagree 

2  =  Moderately  disagree 

3  =  Slightly  disagree 

4  =  Neither  agree  nor  disagree 


5  =  Slightly  agree 

6  =  Moderately  agrep 

7  =  Strongly  agree 


Select  the  corresponding  number  for  each  item  and  enter  it  on  the  separate 
response  sheet. 
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5  =  Slightly  agree 

6  =  Moderately  agree 

7  =  Strongly  agree 


1  =  Strongly  disagree 

2  =  Moderately  disagree 

3  =  Slightly  disagree 

4  =  Neither  agree  or  disagree 

82.  Ideas  developed  by  my  work  group  are  readily  accepted  by  management  per¬ 
sonnel  above  my  supervisor. 

83.  My  organization  provides  all  the  necessary  information  for  me  to  do  my 
job  effectively. 

84.  My  organization  provides  adequate  information  to  my  work  group. 

85.  My  work  group  is  usually  aware  of  important  events  and  situations. 

86.  My  complaints  are  aired  satisfactorily. 

87.  My  organization  is  very  interested  in  the  attitudes  of  the  group  members 
toward  their  jobs. 

88.  My  organization  has  a  very  strong  Interest  in  the  welfare  of  its  peo¬ 
ple. 

89.  I  am  very  proud  to  work  for  this  organization. 

90.  I  fee 1  responsible  to  my  organization  in  accomplishing  its  mission. 

91.  The  information  in  my  organization  is  widely  shared  so  that  those  need¬ 
ing  it  have  it  available. 

92.  Personnel  in  my  unit  are  recognized  for  outstanding  performance. 

93.  1  am  usually  given  the  opportunity  to  show  or  demonstrate  my  work  to 
others. 

94.  There  is  a  high  spirit  of  teamwork  among  my  co-workers. 

95.  There  is  outstanding  cooperation  between  work  groups  of  my  organiza¬ 
tion. 

96.  My  organization  has  clear-cut  goals. 

97.  I  feel  motivated  to  contribute  my  best  efforts  to  the  mission  of  my 
organization. 

98.  My  organization  rewards  individuals  based  on  performance. 

99.  The  goals  of  my  organization  are  reasonable. 

100.  My  organization  provides  accurate  Information  to  my  work  group. 


JOB  RELATED  ISSUES 


The  items  below  are  used  to  determine  how  satisfied  you  are  with  specific  job 
related  issues.  Indicate  your  degree  of  satisfaction  or  dissatisfaction  with 
each  Issue  by  choosing  the  most  appropriate  phrase. 

1  =  Extremely  dissatisfied  5  -  Slightly  satisfied 

2  =  Moderately  dissatisfied  6  =  Moderately  satisfied 

3  =  Slightly  dissatisfied  7  =  Extremely  satisfied 

4  =  Neither  satisfied  nor  dissatisfied 

Select  the  corresponding  number  for  each  question  and  enter  it  on  the  sepa¬ 
rate  response  sheet. 


101.  Feeling  of  Helpfulness 

The  chance  to  help  people  and  Improve  their  welfare  through  the  per¬ 
formance  of  my  job.  The  Importance  of  my  job  performance  to  the  wel¬ 
fare  of  others. 

102.  Co-Worker  Relationship 

My  amount  of  effort  compared  to  the  effort  of  my  co-workers,  the  extent 
to  which  my  co-workers  share  the  load,  and  the  spirit  of  teamwork  which 
exists  among  my  co-workers. 

103.  Family  Attitude  Toward  Job 
The  recognition  and  the  pride  my  family  has  in  the  work  I  do. 

104.  On-the-Job  Training  (OJT) 

The  OJT  instructional  methods  and  instructors'  competence. 

105.  Technical  Training  (Other  than  OJT) 

The  technical  training  I  have  received  to  perform  my  current  job. 

106.  Work  Schedule 

My  work  schedule;  flexibility  and  regularity  of  my  work  schedule;  the 
number  of  hours  I  work  per  week. 

107.  Job  Security 

108.  Acquired  Valuable  Skills 

The  chance  to  acquire  valuable  skills  in  my  job  which  prepare  me  for 
future  opportunities. 


109.  My  Job  as  a  Whole 
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Table  1 

Sample  Demographics:  Age,  Sex,  Personnel  Category 
Three  Year  Study 

Average 


Fraction 

IHJ£I 

%  Hale 

%  Officers 

%  Enlisted 

%  Civilla 

1 

30.8 

84.2 

15.8 

66.6 

17.6 

2 

30.2 

84.9 

10.0 

68.3 

21.7 

3 

31.3 

81.8 

16.7 

60.4 

22.9 

4 

30.6 

82.6 

13.6 

76.2 

10.2 

5 

31.3 

82.1 

16.3 

59.3 

24.4 

Note:  Age  range 

for  all 

samples  was  17- 

■64 

Table  2 


Time  In  Service 


Sample  Demographics:  Time  in  Service 
Three  Year  Study 

Fraction  1  Fraction  2  Fraction  3  Fraction  4  Fraction  5 


Less  than  1  yr. 

11.2 

7.5 

6. 

1-2  Years 

8.8 

9.6 

11. 

2-3  years 

7.9 

9.0 

10. 

3-4  years 

8.2 

9.2 

10. 

4-8  years 

16.2 

.  17.7 

17. 

8-12  years 

47.2 

46.4 

43. 

More  than  12  yrs. 

0.5 

0.6 

0. 

Table  3 

Functional  Area  Composition  of  Sample  Fractions 
Three  Year  Study 

Functional 

Area  Fraction  1  Fraction  2  Fraction  3  Fraction  4  Fraction  5 


Wing/Staff 

2.8 

2.0 

8.7 

6.8 

1.2 

Combat  Spt  Gp 

18.5 

37.5 

20.4 

19.3 

22.1 

Resources 

7.9 

10.4 

10.9 

13.7 

10.3 

Mai ntenance 

13.2 

18.8 

8.7 

28.4 

24.8 

Operations 

4.4 

5.5 

2.1 

6.1 

7.3 

Hospl tal 

8.1 

2.6 

6.2 

5.5 

5.0 

Missiles 

0.0 

0.0 

8.3 

0.0 

0.2 

Communications 

2.1 

0.5 

2.2 

4.0 

4.0 

Uni que 

40.8 

18.5 

13.9 

2.7 

4.1 

Ml  sc. 

2.2 

4.2 

18.6 

13.5 

21.0 

i m 

TOT 

TOT 

1001 

1001 

37 


4. 
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Variable  Numbers  for  OAP  Attitudinal  Items 
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To  what  extent  does  your  job  provide 
you  with  a  chance  to  finish  completely 
the  piece  of  work  you  have  begun? 
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Opportunities  to  perform  a  variety  of  tasks. 
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your  own  procedures  to  accomplish  it? 

To  what  extent  are  you  able  to  determine  how 
well  you  are  doing  your  job  without  feedback 
from  anyone  else? 
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313  95  There  is  outstanding  cooperation  between  work 

groups  of  my  organization. 
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Acquired  Valuable  Skills 

The  chance  to  acquire  valuable  skills  in  my 

job  which  prepare  me  for  future  opportunites 


1 

>v 

V-‘ 

<v 
>-■!  • 

Variable 

Number 

Table  1 
Factor  Loading: 

Fraction  1  Fraction 

Supervision 

2  Fraction  3 

Fraction  4 

Fraction  5 

*-v 

i 

V435 

CO 

00 

• 

00 

• 

.83 

.82 

.83 

V 

V412 

.82 

.82 

.82 

.82 

.82 

.. 

V445 

.80 

.81 

.80 

o 

00 

• 

.80 

V424 

.79 

o 

00 

. 

00 

• 

.78 

.79 

L\‘. 

V431 

.79 

.79 

.79 

.78 

.79 

V404 

.78 

.78 

.77 

.78 

.78 

i  ;; 

u,"z. 

V416 

.78 

.79 

.77 

.76 

.76 

Si 

»  _  . 

V411 

.77 

.77 

.76 

.76 

.76 

> 

V437 

.77 

00 

r^ 

• 

.77 

.78 

.78 

i 

V413 

.76 

.78 

.76 

.75 

.77 

Jm 

V428 

.76 

.76 

.75 

.74 

.75 

V433 

.75 

.77 

.75 

.75 

.76 

i 

V410 

.75 

.76 

.75 

.74 

.74 

V442 

.75 

.76 

.75 

.74 

.76 

.* 

V426 

.74 

.75 

.74 

.74 

.75 

r  ' _ 

V436 

.71 

.73 

.72 

.71 

.71 

« 

V405 

.70 

.70 

.71 

.68 

.69 

V439 

.69 

.72 

.70 

.68 

.68 

4 

V434 

.47 

.46 

.44 

.41 

.47 

V216 

.39 

(.37) 

(.35) 

.35 

.38 

r  . 

V711 

(.33) 

(.34) 

(.34) 

.36 

(.33) 

M 


* 
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Table  2 

Factor  Loading:  Organizational  Climate 


Variable 

Number  Fraction  1  Fraction  2  Fraction  3  Fraction  4  Fraction  5 


Table  3 


Factor  Loading: 

Work  Group  Effectiveness 

Variable 

Number 

Fraction  1 

Fraction  2 

Fraction  3  Fraction  4 

Fraction  5 

V260 

.75 

.75 

.76 

.76 

.76 

V261 

.74 

.73 

.73 

.73 

.74 

V265 

.74 

.74 

.75 

.74 

.75 

V264 

.69 

.67 

.68 

.66 

.67 

V259 

.64 

.68 

.66 

.66 

.66 

V238 

.55 

.54 

.56 

.56 

.56 

V709 

.54 

.53 

.54 

.54 

.54 

V312 

.50 

.49 

.49 

.49 

.48 

Table  4 

Factor  Loading:  Task  Characteristics 


Variable 

Nunber 


Fraction  1  Fraction  2  Fraction  3  Fraction  4  Fraction  5 


t 


V 


* 

\V 

Factor  Loadin 

*  ** 

Variable 

8j 

Number 

Fraction 

V723 

.64 

V710 

.61 

1 

V215 

.55 

k* »; 

. 

V275 

.52 

“  € 

%  ' 

V719 

.52 

1 

V718 

.50 

* 

V705 

.48 

V712 

.42 

Si 

V717 

(.38) 

■■ 

V711 

(.35) 

Table  5 

Job  Role  Pride  &  Satisfaction 


Fraction  2 

Fraction  3 

Fraction  4 

Fraction 

.61 

.62 

.61 

.63 

.59 

.57 

.58 

.56 

.50 

.50 

.53 

.52 

.48 

.49 

.51 

.50 

.51 

.48 

.49 

.52 

.53 

.51 

.49 

.50 

.44 

.46 

.48 

.43 

.42 

.41 

.38 

.41 

.45 

.45 

.42 

.41 

(.35) 

.35 

(.31) 

.36 

P 


Table  6 


ft 

Factor  Loading: 

Need 

For  Enrichment 

*  *  • 

Variable 

Number 

Fraction  1  Fraction  2 

Fraction  3 

Fraction  4 

Fraction  5 

^ ' 

V252 

.88 

.88 

.88 

.88 

.87 

r; 

V251 

.86 

.87 

.86 

.87 

.87 

»*,  • 

V250 

.85 

.85 

.85 

.85 

.86 

* 

V253 

.76 

.79 

.78 

.78 

.78 

r 

V249 

.70 

.71 

.69 

.69 

.68 

r*  52 


Variable 

Number 

Table  7 

Factor  Loading:  Task  Autonomy 

Fraction  1  Fraction  2  Fraction  3 

Fraction  4 

Fraction  5 

V271 

.79  .79 

.81 

.80 

.80 

V213 

.76  .76 

.78 

.76 

.76 

V270 

.74  .73 

.72 

.74 

.74 

V214 

.61  .62 

.62 

.62 

.63 

V272 

.42  .41 

.43 

.44 

.42 

V717 

.39  (.39) 

(.38) 

(.37) 

(.40) 

Table  8 

Factor  Loading:  Job  Performance  Goals 

Variable 

Number 

Fraction  1  Fraction  2 

Fraction  3 

Fraction  4 

Fraction  5 

V274 

.79  .79 

.79 

.78 

.81 

V273 

.79  .78 

.79 

.77 

.80 

V217 

.64  .65 

.67 

.62 

.64 

V221 

.61  .59 

.61 

.63 

.63 

Table  9 

Factor  Loading:  Advancement/Recognition 

Variable 

Number 

Fraction  1  Fraction  2 

Fraction  3 

Fraction  4 

Fraction  5 

V239 

.74  .74 

.75 

.74 

.73 

V276 

.60  .60 

.61 

.60 

.57 

V234 

.59  .61 

.61 

.64 

.58 

V240 

.56  .56 

.58 

.54 

.57 

V241 

.47  .47 

.46 

(.41) 

.48 
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Table  10 

Factor  Loading:  Work  Support 


'■'V  ■  . 


Variable 


t't 


Number 

Fraction  1 

Fraction  2 

Fraction  3 

Fraction  4 

Fraction  5 

V207 

.80 

.80 

.78 

.80 

.78 

V277 

.76 

.76 

.75 

.76 

.76 

V208 

.65 

.63 

.60 

.66 

.61 

Table  11 


Factor  Loading:  Work  I tterferences 

Variable 

1 

Number 

Fraction  1 

Fraction  2  Fraction  3 

Fraction  4 

Fraction  5 

V278 

.82 

.81  .83 

.81 

.80 

MmSSI 

V206 

.80 

.78  .81 

.79 

.78 

> 

V279 

.44 

O 

• 

CO 

• 

.41 

.41 

f  •  ' 

V218 

(.33) 

.39  (.32) 

(.30) 

.46 

F 

Table  12 

m 

Variable 

Factor 

Loading:  Repetition 

Number 

Fraction  1 

Fraction  2  Fraction  3 

Fraction  4 

Fraction  5 

V226 

.78 

.79  .75 

.76 

.74 

V227 

.77 

.78  .76 

.74 

.72 

54 


Factor  Loading:  Desired  Repetitive  Easy  Tasks 


Variable 

Number  Fraction  1  Fraction  2  Fraction  3  Fraction  4  Fraction  5 


Variable  Number 

Time  1 

Time 

V309 

.77 

.73 

V302 

.76 

.74 

V305 

.75 

.78 

V306 

.75 

.79 

V318 

.74 

.72 

V316 

.72 

.74 

V313 

.70 

.61 

V304 

.70 

.75 

V303 

.69 

.61 

V310 

.68 

.70 

V314 

.68 

.70 

V307 

.68 

.77 

V301 

.66 

.75 

V317 

.65 

.72 

V315 

.61 

.71 

V300 

.59 

.67 

V311 

.55 

.59 

V308 

.54 

.59 

V312 

.52 

.51 

V214 

.47 

.48 

V238 

.42 

(.27) 

V705 

.37 

(.38) 

V  723 

(.43) 

.59 

V712 

(.30) 

.52 

V711 

(.35) 

.48 

V719 

(.32) 

.48 

V718 

(.30) 

.47 

57 


Variable  Number 


Table  16 

Factor  Loadings:  Task  Autonomy 
Time  1 


Time  2 


(.21) 

(.23) 


(.24) 


Table  17 

Factor  Loadings:  Work  Group  Effectiveness 


Variable  Number 


Time  1 


Time  2 


(.38) 


58 


Table  18 

Factor  Loadings:  Need  For  Enrichment 


Variable 

Number 

Time  1 

Time  2 

V251 

.88 

.90 

V252 

.87 

.89 

V250 

.85 

.88 

V253 

.80 

.82 

V249 

.78 

.81 

Table  19 

Factor  Loadings:  Job  Performance  Goals 

Variable 

Number 

Time  1 

Time  2 

V273 

.77 

.75 

V274 

.73 

.75 

V217 

.55 

.54 

V221 

.49 

.38 

V211 

(.15) 

.37 

Table  20 

Factor  Loadings:  Advancement/Recognition 

Variable 

Number 

Time  1 

Time  2 

08 


Table  21 

Factor  Loadings:  Task  Characteristics 


Variable 

Number 

Time  1 

Time  2 

V203 

.71 

.72 

V210 

.57 

.58 

V202 

.50 

.62 

V211 

.39 

(.33) 

V215 

.39 

.56 

V201 

(.44) 

.70 

V212 

(.33) 

.70 

V275 

(.32) 

.58 

V705 

(.23) 

.44 

Table  22 

Factor  Loadings:  Job  Role  Pride 

&  Satisfaction 

Variable 

Number 

Time  1 

Time  2 

V718 

.63 

(.25) 

V719 

.55 

(.43) 

V710 

.50 

.53 

V717 

.50 

(.26) 

V  723 

(.45) 

(.30) 

V712 

.43 

(.46) 

Table  23 

Factor  Loadings:  Work  Support 


Variable  Number 

Time  1 

Time  2 

V207 

.73 

.69 

V277 

.68 

.58 

V208 

.67 

.63 

60 


Factor  Loadings:  Work  Interference 


Variable  Number 

Time  1 

Time 

V278 

.76 

.73 

V206 

.75 

.78 

V218 

.54 

(.26) 

V279 

.50 

(.32) 

Table  25 

Factor  Loadings:  Work  Repetition 

Variable  Number 

Time  1 

Time 

V226 

-.76 

.73 

V227 

-.76 

.79 

V279 

(-.17) 

.37 

Table  26 

Factor  Loadings:  Desired  Repetitive  Easy  Tasks 


Variable  Number 


Time  1 


Time 
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APPENDIX  E 


TABLE  i 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  i  AND  FRACTION  2 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  2 


FRACTION  1 


1 

n 

A. 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

1 

3 

99 

♦  60 

.34 

.50 

♦  13 

.45 

.33 

.40 

.45 

.28 

-.17 

-.13 

.0 

6 

60 

.99 

.43 

.55 

♦  17 

.63 

.45 

.44 

.49 

.41 

-.28 

-.22 

.0 

4 

50 

.56 

.45 

.99 

.22 

.49 

.34 

.40 

.37 

.30 

-.12 

-.12 

.0 

i3 

31 

.39 

.99 

.43 

.35 

.52 

.47 

.44 

.42 

.24 

.08 

-.16 

.0 

i2 

46 

.64 

.60 

.50 

.24 

.99 

.45 

.45 

.49 

.31 

-.20 

-.24 

.0 

4 

13 

.16 

♦  35 

.22 

.99 

.23 

.27 

.23 

.21 

.17 

.03 

-.03 

-.2 

!5 

33 

.46 

.50 

.35 

.27 

.45 

.99 

.35 

.35 

.33 

-.17 

-.24 

-.0 

12 

40 

♦  45 

.52 

.41 

.24 

.44 

.38 

.99 

.40 

.39 

-.22 

.04 

.0 

15 

45 

.50 

.43 

.36 

.20 

.49 

.35 

.37 

.99 

.28 

-.06 

-.11 

.0 

i4 

28 

.42 

.29 

.31 

.  17 

.31 

.31 

.40 

♦  28 

.99 

-.25 

-.05 

.0 

>2 

TABLE  2 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  1  AND  FRACTION  3 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  3 

FRACTION  1 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

1 

.99 

.60 

.32 

.49 

.12 

.46 

.32 

.40 

.44 

♦  29 

-.15 

-.12 

.04 

2 

.60 

.99 

.40 

.54 

.16 

.64 

.44 

.44 

.49 

.40 

-.24 

-.20 

.02 

3 

.50 

♦  55 

.43 

.99 

.21 

.50 

.33 

.40 

.36 

.31 

-.10 

-.10 

.01 

4 

.30 

.38 

.99 

.42 

.33 

•  53 

.47 

.48 

.42 

.24 

.09 

-.14 

-.02 

5 

.46 

.62 

.59 

.47 

.23 

♦  99 

.44 

.45 

.50 

.29 

-.15 

-.21 

.01 

6 

.12 

.16 

.34 

♦  22 

♦  99 

.23 

.28 

.23 

.20 

.18 

.01 

-.03 

-.26 

7 

.33 

.44 

.46 

.33 

.27 

.46 

.99 

♦  36 

.34 

.34 

-.14 

-.24 

-.02 

8 

.40 

.45 

.50 

♦  40 

.23 

.45 

.36 

.99 

.39 

♦  40 

-.17 

.06 

.05 

9 

.44 

.49 

.41 

.36 

.19 

.49 

.35 

.38 

♦  99 

.28 

-.04 

-.12 

.03 

10 

.29 

.40 

♦  27 

.31 

.17 

.31 

.31 

.40 

.28 

.98 

-.23 

-.01 

.01 

11 

-.17 

-.26 

.07 

-.13 

.01 

-.18 

-.15 

-.19 

-.06 

-.27 

.98 

.11 

.01 

12 

-.12 

-.20 

-.12 

-.10 

-.02 

-.22 

-.23 

.08 

-.10 

-.01 

♦  11 

.98 

.19 

13 

.06 

.04 

.00 

.01 

-.26 

.03 

-.03 

.07 

.04 

.01 

.04 

.15 

.98 
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APPENDIX  E 


TABLE  3 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  1  AND  FRACTION  4 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  4 


FRACTION  1 


11  CM  CO  <r  If) 


e. .  r  m  *  -  %  _  *».«  « 


M6M 


APPENDIX  E 


TABLE  4 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  1  AND  FRACTION  5 
USING  COEFFICIENTS  OF  CONGRUENCE 


FRACTION  1 


FACTORS  FOR  FRACTION  5 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

99 

♦  59 

.50 

.30 

.14 

♦  45 

.32 

♦  40 

.44 

.27 

-.14 

-.13 

58 

.99 

.53 

.37 

.18 

.62 

♦  44 

.43 

.49 

.41 

-.24 

-.21 

50 

♦  55 

.99 

.22 

.48 

.33 

.39 

.35 

.30 

-.10 

-.09 

30 

.38 

.40 

.99 

.36 

.54 

.47 

.45 

.42 

♦  23 

.15 

-.15 

45 

.62 

.48 

.55 

.26 

.99 

.45 

.44 

.48 

.32 

—  .16 

-.22 

L»l<, 


TABLE  5 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  2  AND  FRACTION  3 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  3 


FRACTION  2 


1 

2 

3 

4 

5 

6 

1 

.99 

.60 

.32 

.49 

.12 

.46 

2 

.59 

.99 

.41 

.  55 

.16 

.64 

3 

.33 

.42 

.99 

.44 

.35 

.57 

4 

♦  50 

♦  55 

♦  44 

.99 

♦  22 

♦  50 

5 

.13 

.16 

.36 

.23 

.99 

♦  25 

6 

.45 

.62 

.55 

.47 

♦  23 

♦  99 

7 

.32 

.44 

.49 

.34 

.27 

.46 

8 

.39 

.42 

.45 

.37 

.22 

.43 

9 

.44 

.50 

♦  41 

.36 

.19 

.48 

10 

.28 

.40 

.26 

.29 

.18 

.31 

11 

-.17 

-.28 

.09 

-.12 

♦  03 

-.19 

12 

-.13 

-.21 

-.18 

-.13 

-.04 

-.25 

13 

.06 

.04 

.01 

.01 

-.27 

♦  03 

7 

8 

9 

10 

11 

12 

13 

.31 

.40 

.45 

.28 

-.14 

-.11 

.05 

.44 

♦  43 

.50 

.41 

-.23 

-.20 

.03 

.52 

.51 

.43 

.28 

.05 

-.13 

-.03 

.34 

.39 

.35 

.31 

-.09 

-.11 

.00 

.28 

♦  23 

.20 

.19 

.01 

-.03 

-.27 

.45 

.42 

.49 

.29 

-.15 

-.24 

.00 

.99 

♦  35 

.34 

♦  33 

-.13 

-.26 

-.03 

.33 

.99 

.36 

.40 

-.16 

♦  08 

.06 

♦  35 

.39 

.99 

.27 

-.05 

-.13 

.03 

.32 

.38 

♦  28 

.98 

-.24 

-.02 

-.01 

-.15 

-.22 

-.07 

-.27 

.98 

♦  11 

.03 

-.27 

.07 

-.11 

-.05 

.11 

.98 

.18 

-.04 

.06 

.04 

.00 

♦  04 

.17 

.98 
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TABLE  6 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  2  AND  FRACTION  4 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  4 

FRACTION  2 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

1 

.99 

.60 

♦  51 

.46 

.14 

.31 

♦  34 

.41 

.44 

.27 

-.14 

-.10 

.04 

2 

.60 

.99 

.54 

.64 

.18 

.37 

.45 

.44 

.48 

.39 

-.26 

-.19 

.03 

3 

.34 

.42 

.43 

.60 

.37 

.98 

.54 

.52 

.44 

.24 

.04 

-.09 

-.05 

4 

.51 

» 55 

.99 

.49 

.23 

.40 

.35 

.40 

.35 

.27 

-.12 

-.09 

-.01 

5 

.14 

.17 

.22 

.26 

.99 

.36 

.30 

.24 

.22 

.15 

.01 

-.01 

-.28 

6 

.46 

.63 

.46 

.99 

.25 

.49 

.47 

♦  43 

♦  47 

.30 

-.19 

-.22 

.01 

7 

.34 

.45 

♦  33 

.47 

.29 

.45 

.99 

.37 

.36 

.28 

-.17 

-.23 

-.03 

8 

.40 

.42 

.38 

♦  43 

.23 

.43 

.38 

.99 

.37 

.36 

-.16 

.10 

.05 

9 

.45 

.49 

.36 

.50 

.21 

.40 

.38 

.39 

.99 

.26 

-.04 

-.10 

.01 

10 

.29 

.40 

.28 

.30 

.17 

.22 

♦  31 

.37 

.27 

.98 

-.27 

-.01 

.00 

11 

-.17 

-.29 

-.12 

-.20 

.02 

.08 

-.16 

-.21 

-.04 

-.26 

♦  96 

♦  09 

.06 

12 

-.13 

-.22 

-.12 

-.25 

-.04 

-.16 

-.23 

.03 

-.13 

-.05 

.12 

.97 

.17 

13 

.06 

.05 

.01 

.02 

-.28 

.01 

-.03 

.07 

♦  04 

.00 

.03 

.17 

.97 
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TABLE  7 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  2  AND  FRACTION  5 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  5 


FRACTION  2 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

1 

.99 

.58 

.50 

.30 

.13 

.45 

.31 

.39 

.45 

.26 

-.14 

-.12 

.05 

2 

.58 

.99 

.54 

.38 

♦  18 

.63 

♦  44 

.42 

.49 

.42 

-.23 

-.21 

.04 

3 

.33 

.42 

.43 

.98 

.38 

.58 

.51 

.48 

.43 

.26 

.10 

-.15 

-.02 

4 

.49 

♦  55 

.99 

.42 

.23 

.48 

.34 

.38 

.35 

.29 

-.10 

-.10 

.02 

5 

.13 

.17 

.23 

.36 

.99 

.26 

.29 

.24 

.21 

.18 

.04 

-.04 

-.26 

6 

.44 

.62 

.47 

.50 

.26 

♦  99 

.46 

.41 

.47 

♦  32 

-.16 

-.24 

.02 

7 

.31 

.45 

.33 

,46 

,29 

.46 

.99 

.35 

.34 

.34 

-.11 

-.26 

-.03 

8 

.39 

.43 

.38 

.47 

.24 

.42 

.33 

.99 

.36 

.35 

-.18 

.08 

.06 

9 

.44 

.50 

♦  35 

.39 

.23 

.49 

♦  35 

.38 

.99 

.28 

-.03 

-.13 

.01 

10 

.27 

.40 

.29 

.25 

,19 

.31 

♦  31 

.36 

.27 

.98 

-.24 

-.04 

.01 

11 

-.17 

-.28 

-.13 

.06 

.02 

-.17 

-.15 

-.19 

-.08 

-.25 

.98 

♦  12 

.02 

12 

- ,  1 3 

-.21 

-.11 

-.11 

-.05 

-.27 

-.26 

.05 

-.12 

-.07 

♦  06 

.97 

.18 

13 

.06 

.05 

.01 

.02 

-.25 

.02 

-.04 

♦  06 

.03 

♦  01 

.05 

.16 

.98 
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TABLE  8 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  3  AND  FRACTION  4 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  4 

FRACTION  3 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

1 

.99 

.60 

.51 

.46 

.14 

.30 

.34 

.41 

.43 

.27 

-.15 

-.10 

.04 

2 

.60 

.99 

.54 

.62 

.17 

.36 

.43 

.43 

.47 

♦  38 

-.25 

-.19 

.02 

3 

.32 

.39 

.41 

.58 

.36 

.98 

.51 

.49 

.43 

.21 

.07 

-.10 

-.04 

4 

.50 

.54 

.99 

.47 

.23 

♦  39 

.34 

.38 

.35 

.28 

-.12 

-.09 

-.02 

5 

.13 

.16 

.22 

.25 

.99 

.34 

.29 

.23 

.20 

.  16 

.00 

-.02 

-.29 

6 

.47 

.64 

.47 

.99 

.26 

.50 

.48 

.45 

♦  47 

.29 

-.18 

-.22 

.01 

7 

.33 

.43 

.32 

.47 

.29 

.45 

.99 

♦  35 

.36 

♦  28 

-.16 

-.23 

-.06 

8 

.41 

.43 

.38 

.44 

.23 

.46 

♦  39 

.99 

.38 

.36 

-.16 

.11 

.05 

9 

.45 

.49 

.34 

.50 

♦  20 

.40 

.37 

.37 

.99 

.26 

-.04 

-.10 

.01 

10 

.29 

.40 

.29 

.28 

.19 

.22 

.32 

.38 

.27 

.98 

-.29 

-.01 

♦  01 

11 

-.14 

-.25 

-.10 

-.15 

.01 

.08 

-.13 

-.16 

-.03 

-.24 

♦  97 

.08 

.06 

12 

-.12 

-.21 

-.10 

-.22 

-.04 

-.13 

-.23 

.05 

-.14 

-.02 

.12 

.98 

.17 

13 

.04 

.03 

-.01 

-.01 

-.29 

-.02 

-.03 

.07 

.03 

.00 

♦  02 

.18 

.98 
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TABLE  9 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  3  AND  FRACTION  5 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  5 

FRACTION  3 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

1 

.99 

.59 

.29 

.13 

.45 

.31 

.39 

.44 

.27 

-.14 

-.12 

.05 

2 

.58 

.99 

.53 

.37 

.17 

.61 

.42 

.42 

.49 

.40 

-.23 

-.20 

.03 

3 

.31 

.41 

.98 

.37 

.57 

.48 

♦  45 

.41 

.24 

.15 

-.16 

-.01 

4 

.49 

♦  54 

♦  99 

♦  23 

.46 

.33 

.37 

.34 

.29 

-.10 

-.10 

.00 

5 

.11 

.16 

.22 

.34 

.99 

.24 

♦  29 

♦  22 

.20 

.19 

.04 

-.05 

-.27 

6 

.45 

.63 

.48 

.52 

.26 

.99 

.46 

.42 

.46 

.31 

-.15 

-.23 

.02 

7 

.31 

.43 

♦  32 

.47 

.46 

.99 

.33 

.34 

.33 

-.10 

-.26 

-.05 

8 

.43 

.39 

♦  24 

♦  42 

.34 

.99 

.38 

.34 

-.19 

.09 

.07 

9 

.44 

.49 

♦  34 

.39 

.22 

♦  50 

.34 

.37 

.99 

.28 

-.03 

-.12 

.01 

10 

.27 

.31 

.25 

.21 

.28 

.32 

.37 

.26 

.98 

-.26 

-.05 

.  02 

11 

-.14 

-.23 

.06 

-.12 

-.12 

-.15 

-.06 

-.24 

.97 

.13 

.03 

12 

-.12 

-.20 

-.07 

-.25 

-.26 

.07 

-.13 

-.04 

♦  05 

.98 

.19 

13 

ai'iig 

UTiFl 

-.27 

uni 

-.05 

.07 

.02 

.01 

.04 

.17 

.98 
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FRACTION  4 


TABLE  10 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
FRACTION  4  AND  FRACTION  5 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  FRACTION  5 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

1 

.99 

.59 

.51 

.31 

.14 

.46 

.33 

.40 

.45 

.28 

-.14 

-.13 

.05 

2 

.59 

.99 

.53 

.36 

.18 

.62 

.43 

.41 

.49 

.41 

-.24 

-.21 

.04 

3 

.50 

.53 

.99 

.39 

.23 

.46 

.32 

.37 

.34 

.28 

-.10 

-.09 

.00 

4 

.45 

.62 

.48 

.54 

.27 

.99 

.48 

.42 

.48 

.30 

-.16 

-.22 

.00 

5 

.14 

.18 

.23 

.36 

.99 

.27 

.31 

.23 

.21 

.19 

,03 

-.05 

-.28 

6 

.30 

.35 

.37 

.98 

.36 

.51 

.45 

.43 

,41 

.21 

.14 

-.14 

-.01 

7 

.33 

.45 

.33 

.49 

.31 

♦  47 

.99 

.38 

,38 

,32 

-.11 

-.22 

-.03 

8 

.41 

,43 

.39 

.50 

.25 

.44 

.36 

.99 

.38 

.33 

-.18 

.05 

.07 

9 

.43 

.47 

.34 

.41 

,24 

.48 

,36 

,38 

.98 

,28 

,01 

-.15 

.01 

10 

.26 

♦  38 

.28 

.21 

.17 

,29 

♦  28 

♦  34 

.25 

.98 

-.25 

-.04 

.02 

11 

-.15 

-.26 

-.13 

.05 

-.01 

-.16 

-.15 

-.16 

-.04 

-.28 

.95 

,15 

.01 

12 

-.10 

-.19 

-.07 

-.03 

-.02 

-.23 

-.23 

.09 

-.10 

-.03 

,03 

.98 

.19 

13 

.04 

.03 

-.01 

-.05 

-.27 

.00 

-.05 

.05 

.00 

,02 

,06 

♦  15 

,98 
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TABLE  11 


COMPARISON  OF  FACTOR  STRUCTURES  FOR 
TIME  1  AND  TIME  2 
USING  COEFFICIENTS  OF  CONGRUENCE 


FACTORS  FOR  TIME  2 


TIME  1 


3 

4 

5 

6 

7 

8 

49 

.29 

.55 

♦  46 

.43 

.46 

56 

.29 

*63 

.58 

.47 

.55 

80 

.36 

.52 

.94 

.47 

.50 

60 

.39 

.93 

.52 

.50 

.41 

36 

.94 

.35 

.29 

.31 

.21 

9 

10 

11 

12 

3 

2 

-.07 

-.11 

.41 

50 

-.19 

-.23 

.47 

40 

-.24 

-.06 

.  4  5 

38 

-.02 

.00 

.41 

19 

.03 

.02 

.15 

4 

8 

.13 

-.10 

.45 

3 

6 

-.20 

-.11 

.48 

3 

2 

-.02 

.01 

3 

5 

-.21 

-.25 

.81 

Appendix  F 

Significance  Levels  for  Congruence  Coefficients 


Table  1 


Significance  Levels  for  Congruence  Coefficients 


D 

Xz 

_ qz _ 

0z 

0:  P(CC>0) 

1 

1.20 

.07 

1.38 

.88 

2 

1.07 

.06 

1.23 

.84 

3 

.98 

.06 

1.14 

.81 

4 

.88 

.06 

1.04 

.78 

5 

.81 

.05 

.94 

.74 

6 

.73 

.05 

.86 

.70 

7 

.65 

.04 

.75 

.64 

8 

.59 

.03 

.67 

.58 

9 

.54 

.03 

.62 

.55 

10 

.49 

.04 

.59 

.53 

11 

.44 

.03 

.52 

.48 

12 

.40 

.02 

.39 

.37 

13 

.34 

.02 

.39 

.37 

14 

.28 

.03 

.36 

.31 

15 

.24 

.03 

.32 

.31 

16 

.20 

.03 

.28 

.27 

Note:  (1)  D  is  the  order  of  factor  matching,  Xz  jjs  the  Fisher  z  transformation  of 
the  mean  congruence  coefficient,  and  ffz  the  Fisher  z  transformation  of 
the  standard  deviation.  Values  of  D,  Xz  and  <Tz  are  from  Korth  and 
Tucker  (1975). 

(2)  0z  is  the  Fisher  z  transformation  of  0,  the  critical  value  of  the 

congruence  coefficient  (CC) 

(3)  Degrees  of  freedom  =  number  of  items  -  number  of  factors  =  93-16=77. 

t. 01, 120  =  2.617 

(4)  0  decreases  with  increasing  numbers  of  variables,  so  that  using  table  for 
80  variables  instead  of  93  is  conservative. 

(5)  0  decreases  with  decreasing  number  of  factors,  so  using  table  for  20 
factors  is  conservative. 
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